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SIMULATOR  TRAINING  1111  (TIVl  NISS  ASA  lUNCTlON  Of  IRROR  COUNTS 
ON  Till  1-1 5 A  IT.IGIH  SIMULATOR  INSTRUC  TOR  Ol’l  RATOR  STATION 


i.  ini  Root 'rrioN 


Background  and  Purpose 

F  light  simulation  is  not  a  leeeni  innovation  in  pilot  naming.  Dotscy  ( ll)7C»)  reported  that  simulators, 
or  traineis,  have  been  available  lot  years  lot  such  diverse  mcchatiisnis  as  ships,  trains,  automobiles,  orbiting 
vehicles,  advanced  radat.  and  airplanes.  However,  the  evolution  of  llight  simulation  It  out  the  complex, 
mechanical  devices  of  World  War  II  vintage,  to  the  digital  eonipnt  ••generated  simulated  tactics  and  targets 
of  today,  is  impressive. 

Ait  force  use  of  flight  simulators  is  incieasing.  Vaiious  factors  such  as  improved  simulator 
technology,  ineteased  costs  of  operating  airmail,  fuel  costs  and  scarcity,  environmental  effects  of  aitcraft 
operations,  and  safety  reasons  are  causing  the  Air  boree  to  increasingly  depend  upon  simulator  naming  to 
help  keep  personnel  combat  ready  (Cato.  I'>77a).  Simulator  use  is  expected  to  increase  and.  as  a  function 
of  increased  training  capability,  provide  better  training. 

With  ineteased  simulatoi  use  rei|uiientents.  effective  design  and  implementation  o!  simulator  training 
programs  must  he  considered.  Simulator  training  managers  tend  to  assume  that  simulators  are  always 
optimally  designed  and  used  (Cato,  1  ‘>77b ).  Ui.wevet,  extensive  use  dries  not  insure  efficient  training.  In 
one  study,  for  example,  it  was  found  that  the  extensive  use  of  a  particular  device  added  cost,  but  no 
training  value,  to  an  already  expensive  pilot  tiaimng  program  (Isley.  Caro.  &  Jolley.  I4PH)  This  finding  was 
hugely  attributed  to  the  less-than-optima!  design  of  that  particular  device  (Caro.  IR70).  There  are  few 
studies  which  evaluate  simulator  training  in  quantitative  teinis.  Most  are  based  upon  subjective  opinion 
ratliei  than  ob|eet  ive  data.  Bui  get  and  Brictson  (Ih7h)  reported  that  systematic,  controlled  studies  with 
simulutois  may  inlet  fete  with  opeiational  tiaining  schedules,  and  cognizant  personnel  may  lack  the  time 
and  rcsouiees  necessaiy  to  conduct  such  investigations.  In  addition,  quantitative  and  measurable 
performance  eiiteria  have  not  yet  been  established.  So  the  simulatoi  researcher  is  faced  with  the  difficulty 
of  implementing  a  classical  experimental  design  within  an  operational  setting. 

Charles,  Willard,  and  Healey  ( I '>75 )  revealed  that  lack  of  effective  training  existed  for  instructor 
pilots  (It’s)  and  simulator  operators  (SOs)  in  both  simulatoi  opeiation  and  utilization,  and  in  “how  to 
instinct.”  Therefore,  simulator  training  was  not  well  employed, standardized,  or  in  general,  appieeiated  by 
IPs.  The  role  of  the  IP  was  found  to  vary  within  the  system  in  terms  of  crew  size  and  pilot  task,  with  the 
tole  of  the  SO  depending  on  the  establishment  of  the  IP  role.  In  addition,  the  proliferation  of  displays  and 
controls  on  the  instiuctui/opcator  station  (IOS)  may  lie  detrimental  to  effective  training 

Mueklet.  Nygaard,  O’Kelly,  and  Williams  (ll)?‘>)  repotted  that  many  studies  compound  the  impact  of 
such  potential  inllitcnccs  as  tiaining  program  content,  instructional  technique,  and  mstructoi  qualification 
into  a  single  independent  variable.  Realized  benefits,  then,  can  be  attributed  only  to  the  unique 
combination  of  those  influences.  Genet  alt  z.at  tons,  howevet.  must  be  cautious  since  these  studies  are  seldom 
replicated  and  may  address  unique  training  tequirements. 

Some  factors  which  may  influence  simulator  training  effectiveness  include  visual  fidelity,  motion 
illicitly,  trainee  and  instiuctoi  characteristics,  altitudes  and  expectations,  among  others.  Simulatoi 
managers  must  include  these  factors  in  the  ovetall  evaluation  of  simulator  training.  Utiawai eness  ot  such 
influences  may  result  in  inadequate  development  of  critical  skills,  unnecessary  use  of  aircraft,  excessive 
tiaining  costs,  and  inclticicnt  simulator  tiaimng.  L fleet  ive  simulator  training  is  critical  if  the  Ait  force  is  to 
comply  with  the  Department  of  Defense  goal  ot  significant  reduction  in  aiieiaft  use  for  llight  tiaimng  by 
l‘M  I .  while  st ill  maintaining  the  present  quality  of  that  tiaining  (U  S.  Government  Printing  Office.  Note  1 ). 


The  F-I5A  flight  simulator  (LS),  designed  and  manufactured  by  Goodyear  Aerospace  Corporation 
(Note  2),  represents  a  new  generation  of  advanced  digital  and  simulation  engineering  technology.  This 
simulator  accurately  depicts  the  operational  performance  characteristics  of  the  L-I5A  aircraft  and  creates  a 
controlled,  tactical  environment  where  the  student  can  learn  to  rise  the  F  15 A  weapons  system. 

In  a  recent  Operational  Test  and  I. valuation  (OT&L)  of  'lie  F'-l  5A  FS  Instructor  Operator  Station 
(10S),  several  training  deficiencies  were  noted,  lire  purpose  of  the  OT&L  was  to  consolidate  findings  of 
testing  and  operational  use  and  initiate  modifications  to  make  the  F-15  FS  more  effective  and  efficient.  As 
part  of  the  evaluation,  the  Air  Force  Unman  Resources  Laboratory  (AflIRL)  sponsored  a  Human  Factors 
Test  and  evaluation  (HFT&F)  of  the  F-15  A  FS  IOS. 

The  IOS  represents  the  man-machine  interface  for  the  F-I5A  simulator.  The  cathode  ray  tubes 
(CRTs)  of  the  IOS  present  radar  information,  heads-up  display  (HlJD)  information,  and  a  three  -dimensional 
view  of  the  tactical  environment  including  the  F-15A  and  adversaries.  This  three-dimensional  view  of  the 
emitter  targets  (HTs)  environment  is  a  complex  display  controlled  by  the  right-hand  console  control  board. 
The  di-play  subpanel  is  used  in  conjunction  with  the  keyboard  to  call  up  selected  display  pages  and  to 
control  malfunctions  and  intercept  display  content.  The  tactics  subprnel  is  also  used  with  the  keyboard  to 
position  the  FS  and  to  select,  activate,  and  control  LTs.  This  interaction  is  very  complex  and  requires 
multiple  button-selection  sequencing.  Baer  and  Sanders  ( 1977)  found  that  an  average  of  22  button  pushes 
were  needed  to  select  a  radiating  target,  enter  a  hearing  and  range,  activate,  and  take  manual  contiol.  To 
reinitiate  the  mission,  an  average  of  19  button  pushes  were  required.  The  HFT&F  team  compared  their 
findings  with  the  problems  discussed  in  the  interim  IOS  report  (Baer,  1977).  Both  studies  (Baer,  1977; 
Crites,  1977)  reported  excessive  button  pushing  and  consequential  errors  on  the  tactics  hoard  (right  control 
panel).  Tire  HFT&F  also  revealed  lirat  IP  training  was  insufficient,  resulting  in  trial  and  emu  learning  at  the 
IOS.  Frustrated  IPs  would  often  opt  to  tal  c  manual  control  of  the  airborne  I  Ts  rather  than  set  up  the  more 
difficult  preprogrammed  typical  missions.  "Gaining  appeared  to  suffer  wnen  the  IOS  automatic  capabilities 
were  not  used.  As  a  result,  TaC  has  asked  the  F-15  A  Operations  Training  Development  Team  (OTD)  to 
develop  a  simulator  operatin',  handbook  geared  for  the  line  pilot/instructor.  This  handbook  will  address 
the  piiot  interface  with  the  SO  who,  in  most  cases,  will  he  the  actual  console  operator.  A  course  of 
instruction  in  the  operation  of  the  F-I5A  FS  IOS  has  been  generated  for  new  IPs  at  Luke  AFB.  It  includes 
l  1/2  hours  of  classroom  instruction  by  an  SO  ami  1  1/2  hours  at  the  IOS  wi*h  an  SO  and  a  qualified  IP.  A 
cleatly  written  basic  IOS  operators  handbook  has  been  gcnera'ed,  and  an  IP  has  been  assigned  full  lime  to 
develop  more  preprogrammed  missions. 

In  view  of  findings  during  the  IIFT&t  and  subsequent  actions  by  the  naming  agencies,  AF'HRl./l-T 
undertook  an  effort  to  look  independently  into  the  problem  of  F-l  5A  FS  IOS  operation.  Some  important 
questions  remained  unanswered  (c.g.,  Are  the  error  counts  significant  enough  to  considci  redesigning  the 
tactics  console?  Dr  error  corrections  seriously  detract  from  simulator  training?  Why  do  some  IPs  make  less 
errors  than  others').  This  preliminary  investigation  into  such  questions  utilized  data  from  direct  observation 
of  daily  simulator  operations.  Tire  average  number  of  cirors,  the  average  error  time,  and  the  average  actual 
training  time  were  computed.  In  addition,  IP  average  error  and  electronic  tactics  use  weio  also  investigated. 
The  results  of  this  study  were  compared  to  those  made  in  August  1977  during  the  AFHKL  Sponsored  IOS 
design  study. 


II.  MKTHOD 

In  April  1977,  TAC  began  an  operational  test  and  evaluation  (OT&L)  of  the  F-15A  F'S,  built  by 
Goodyear  Aerospace  Division  and  located  at  Luke  AFB.  Air  Force  Human  Resources  laboratory.  Flying 
Training  Division,  Tactical  Training  Research  Branch  (AFHRL/FTO)  at  Luke  ALB,  was  asked  to  assist  in 
the  conduct  of  the  operational  cvahiation  of  the  F-I5A  LS  hi  several  areas.  This  report  is  an  outgrow  th  of 
the  findings  from  one  of  the  areas  investigated. 
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Design 

A  direct  observation  study  of  daily  simulator  operations  was  the  genera!  research  design.  The 
investigator  collected  data  in  the  1-1 5A  FS  #1  located  at  Luke  AFB  between  C  July  and  3  August  1978. 

During  the  study,  the  simulator  was  operating  continuously  from  0600  hours  to  1800  hours.  Monday 
through  Friday.  Each  day’s  schedule  was  divided  into  eight,  90-mjnute  sessions.  As  students  progressed 
through  the  flight  syllabus,  they  were  assigned  specific  simulator  sessions  at  various  stages  of  their  training. 
As  such,  scheduling  of  simulator  sessions  was  dictated  by  operational  commitments.  A  furthci  complication 
was  computer  downtime  (about  1 0%  of  the  sessions). 

The  investigator  monitored  three  sessions  per  day  at  0900,  1030,  and  1330  hours.  During  monitored 
sessions,  the  investigator  recorded  the  number  of  errors  made  by  the  IPs  at  the  tactics  board,  the  time  taken 
to  correct  errors,  and  total  training  time.  During  unmonitored  sessions,  the  SO  tallied  the  number  of  errors 
made  by  the  IP. 

Any  subjective  information  abou*  simulator  operating  procedures  was  recorded  by  the  investigator 
for  later  use  in  answering  some  difficult  questions  on  simulator  training  effectiveness. 

Subjects 

Tltc  subjects  consisted  of  34  instructor  pilots  qualified  in  the  F-15A  aircraft.  Their  ranks  langed  from 
First  Lieutenant  through  Major.  IP  experience  in  the  F-l  S A  FS  varied  greatly,  ranging  from  0  to  200  hours. 

Sixteen  SOs  were  also  present  in  the  study.  They  seldom  operated  the  IOS  but  they  were  available  to 
answer  questions  and  to  help  with  specific  problems.  Experience  ranged  from  4  months  to  19  months  on 
the  F-I  SA  IOS. 

Apparatus 

Counter.  A  Systron-Donncr  Model  6I52A  digital  counter  was  set  to  nigger  (count)  once  for  each 
illumination  of  the  F.RROR  light  on  the  tactics  console.  It  was  installed  in  the  computer  inpul/output 
cabinet  and  was  not  visible  to  the  IP. 

IP  Questionnaire.  IPs  recoided  their  flying  experience,  including  type  of  aircraft,  total  hours,  and  IP 
hours  in  each  type,  and  simulator  experience,  including  type  of  simulator,  total  hours,  and  IP  hours  in  each 
type  (see  Table  Land  Appendix  A). 


Table  I.  Hours  of  Simulator  Experience  of 
Instructor  Pilots  by  Simulator  Type  and 
Number  of  Instructor  Pilots 


.  LL 

Simulator  Typa 

F-4 

F-15 

T-3® 

A*7 

Total  hours  of 
experience-* 

2,500 

1,875 

500 

250 

Number  of  IPs 

11 

20 

2 

I 

''Rounded  lo  nearest  2a  nours  increment. 


SO  Questionnaire.  Individuals  recorded  experience  as  operator  and/or  technician  on  the  F-15A  FS 
IOS  or  any  additi<  ‘1  simulator  (see  Table  2  and  Appendix  B). 


.  -  -.A  Y.'wi  r  itfe  frilitmii  w 


Table  2.  Months  of  Simulator  Experience  of  Simulator  Operators  by 
Simulator  Type  and  Number  of  Operators 


Simulator  Typ« 

F-15 

F-4E 

A-7D 

SAAC 

coi-c 

F-40 

r-ioo 

F-111  A 

FB-111A  F -1  OSD 

Total  months  of 

experience  175 

142 

73 

49 

45 

42 

36 

17 

17  5 

Number  ol  operators  15 

8 

3 

4 

1 

3 

1 

1 

1  1 

1-I5A  li)S  Tvalualioii  Worksheet.  1  lie  SO  recorded  the  date,  sinmlatoi  number,  course  number, 
names  of  the  SO,  II’.  and  student,  whether  the  session  was  completed,  the  IT  set  minibei ,  the  number  ot 
errors,  and  the  scheduled  session  time  The  investigator  recorded  emus,  error  time,  and  total  trai’iiiii',  time 
during  monitored  sessions  (see  Appendix  O. 

Sto[>  waulics,  One  stopwatch  was  used  to  recoid  total  training  time.  Another  stopwatch  was  used  to 
record  etror  time  iinly  . 

Procedure 

During  immonitored  sessions  (0(>00.  07.10.  1200.  1500.  and  1030  sessions)  the  SO  filled  out  the 
worksheet  and  recorded  the  number  of  errors  displayed  on  the  counter. 

During  monitored  sessions  (OHIO,  1G30.  and  1300  sessions)  the  SO  filled  out  the  worksheet  and  the 
investigator  recorded  the  number  of  errors,  emu  tune,  and  total  training  time  The  total  training  time 
stopwatch  was  started  when  both  the  ll‘  and  student  wcie  seated  and  voice  communication  was  established. 
It  was  stripped  when  ihe  student  removed  the  headset  and  climbed  from  the  cockpit. 

The  error  time  stopwatch  was  starlet,  when  the  error  light  was  activated  and  was  stopped  when  the 
lp  completed  entry  of  the  correct  inhumation. 

The  investigator  also  made  visual  tallies  of  errors  to  confirm  the  number  displayed  on  the  counter.  In 
addition,  the  investigator  talked  on  an  informal  basis  with  IPs  and  SOs  and  made  note  el  any  special 
circumstances  in  the  daily  operation  of  the  simulator  for  future  use. 


III.  RESULTS 

Tlic  results  of  the  evaluation  are  presented  and  discussed  according  •»>  three  topical  areas:  (a)  Session 
Results. (h)  '!*  i'esuUs,  and  (c)  Elect  ionic  Tactics  Results. 

Session  Results 

During  35  monitored  sessions  (52.5  hours)  the  average  error  time  per  session  was  53  seconds  or 
approximately  1%  of  the  scheduled  90  minutes  (a  ~  82).  Each  session  is  comprised  of  front  one  to  several 
varied  mission  events  depending  on  the  syllabus.  Actual  training  time  was  defined  as  total  training  time 
minus  erior  time.  During  monitored  sessions,  the  average  actual  naming  tune  per  session  w  as  76  minutes  or 
84 '/•  of  the  scheduled  90  minutes  (u  =s  II).  Seven  errors  per  session,  on  the  average,  were  committed  by  IPs 
for  107  total  sessions,  including  monitored  and  umnoniiored  sessions  (a  =*9). 

IP  Results 

IPs  in  the  earlier  IOS  design  study  committed  an  average  of  nine  errors  per  session  (o  ^8).  For  those 
with  three  or  more  sessions,  the  average  dropped  to  seven  errors  per  session  (o  ^  5).  The  average  dropped 
further  to  five  errors  per  session  for  those  IPs  in  the  present  study  who  were  also  in  last  year's  study  (o  ^ 
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5).  I'oi  IPs  in  the  present  study  only,  the  cum  count  was  back  up  to  seven  onms  per  session  {a  ^  7 j.  Hie 
liaison  Product  Moment  Conilai km  Coefficient  was  applied  to  detemrne  die  relationship  betwi  -n  the 
nunibei  of  sessions  and  the  average  onor  count  Coi  each  SPfKoscoc,  1975). 

f  or  IPs  in  the  1077  iOS  dcsigti  study,  r  -  -.32, (p  -  .05°).  l  or  IP's  in  the  T-7K  study  .vlio  we.e  also 
m  last  year's  study,  r  =  -  .62,  (p  ~  .00047).  The  difference  between  the  two  correlation  cocffic. ants  v.as 
significant  at  die  .0051  level. 

The  Pearson  Product  Moment  Correlation  Coefficient  was  also  etiicjlated  lot  .!?  hourr-  on  the  C  l  5 A 
PS  versus  ttie  average  error  count.  The  value  of  the  coefficient  (r  =  .022)  indicate*  no  sign. Meant 
relationship  between  II*  hours  oil  the  simulator  and  average  error  count. 

Electronic  Tactics  Results 

The  electronic  tactics  results  indicated  that  ETs  are  being  uscu  in  about  25%  of  the  sessions.  Sy  11a  us 
requirements  dictate  ‘hat  certain  sessions  are  to  be  flown  without  KTs  but  many  IPs  opt  U  use  manual 
targets  (20%  ol  the  sessions)  where  they  arc  in  control  end  can  l.rck  up  or  accelerate  training  according  to 
tlte  individual  student’s  progression.  However,  l  oth,  manual  ta  gets  and  P.l  sets  ere  'espomiblc  for  liigh 
average  error  court's  (1 1  and  10  errois  per  session,  see  Table  31. 


Table  3.  Elec  tronic  Tactics  Reailb- 


T injc l  Mode 

/V/«r*9»  Error* 
Par  Sotsion 

%  of  Sauiunl 

Manual  Targets  and 

ETs  Noi  Used 

2 

45 

ETs  Used 

10 

25 

Manual  largetr  Used 

11 

30 

Although  the  averages  indicate  rather  small  error  counts  and  tim,  s,  theie  was  a  wide  range  of 
variation  among  IPs  Prroi  counts  range  from  0  to  53,  and  some  IPs  spent  over  5  minutes  just  correcting 
eirors.  These  are  important  deviations  wliich  may  be  a  function  of  experience  and  motivation. 


IV.  DISCUSSION  AND  recommendations 

Tlte  present  I0S  design  study  was  a  preliminary  investigation  into  the  error  counts  and  training 
eflcctiveness  of  the  F-l  5A  PS  IQS  and  wit!  serve  as  a  follow  up  to  the  earlier  study.  This  study  attempted 
to  identify  specific  problems  and  indicate  directions  foi  additional  research. 

The  error  time  and  counts  may  not  be  as  important  as  was  previously  thought.  There  was  an  average 
of  seven  errors  per  session  committed  at  the  10S.  Average  error  time  was  53  seconds  per  session  (1%  of 
scheduled  training  time).  However,  there  were  only  76  minutes  (84%)  on  the  average,  of  actual  training 
time  contained  in  one  90-m‘nute  session.  About  15%.  of  the  scheduled  session  time  was  lost  due  to 
computer  malfunction,  or  delayed  start.  Additionally,  errors  in  the  present  study  did  not  seriously  detract 
front  training  ’ine  since  an  average  of  only  8  seconds  was  required  to  correct  an  error.  Training  is  a 
continuous  process,  and  although  an  IP  commits  an  error  at  the  IOS,  the  student  is  still  flying  and  receiving 
training  wliile  the  error  is  being  corrected. 

IPs  did  report  excessive  button  pushing  for  even  the  simplest  maneuvers;  however,  IP  performance 
improved  with  practice.  IPs  in  the  earlier  design  study  committed  an  average  of  nine  errors  per  session,  but 
lor  those  with  three  or  more  sessions  the  average  error  count  dropped  to  seven  errors  per  session.  Among 
IPs  in  the  present  study  who  were  also  in  the  earlier  study,  the  error  count  dropped  Inillier  to  five  errors 


|vji  session  while,  f.  r  those  II*  ;n  the  picscnt  stud;.  oil.',  d.e  a  t'  gc  count  .ciuiikv  to  seven  emus  pci 
session 

idtili/ttig  only  those  pilots  common  to  both  studies,  'lie  coirch'ik-  ,  heiweti  mo.'her  of  s.ssions  ami 
average  erioi  xaint  in  the  pic.ertt  study  was  luyliei  than  ’lelbre  (sec  Piy'rcs  I  &  ?.).  /».;  the  numl.ei  td 
sessions  incicascd.  the  average  emu  ;rm  tended  to  decrease.  However,  there  were  r o  statistical!;.' 
significant  >ciationships  bet  ween  i  ital  IP  boms  on  Mi.  simulatoi  ami  aver-gc  c:  tt,* « «unt.  This  result  may  >c 
explained  by  conxideung  that  the  more  e  0C1  it  need  'i’s  picloned  ,o  stumble  thmugl  the  coir  pi  .a. cd 
swuchology  of  the  f  •  1  5 A  I  S  ratiiei  than  ask  the  ope.;  or  lor  assistance.  Less  expci'cnccd  ll’s  asked  foi 
as  istance  sooner  «.i:d  mote  n! ten.  C o:>seque..(iy .  more  experienced  IPs  terded  10  ha.e  hiy'uu  average  etror 
counts  than  would  noim.tl'.y  he  expee'ed.  Idle  pn’sent  study  iodiea'cs  that  most  I”*  were  no*  sat; died  with 
the  simiilato'  training.  Man;,  pointed  to  the  complex  switcholog;.',  inadequan.  IP  tra;ning,  and  tnc 
ineifective  conputei  i.gic  which  does  no-,  allow  siiiudiunct  us  use  of  the  tactics  and  mission  display  panel 
(Critcs.  1  *>77 )  or  simu'taueous  viewing  of  the  tactics  and  inlerecpis  displays  (B.,c  &  Sauaois,  IS77).  The 
pres ’in  IOS  design  and  limited  I"  Paining  program  did  not  sign;  icantly  affect  training  time,  but  db*  appear 
to  hinder  the  full  development  of  quality  'light  simulator  i-aining. 
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Figure  1 .  h  urn  he1-  ct  sessions  versos  average  error  count  for 
instructor  pilots  in  1^77  study  f.r  =  -  ??.). 
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Figure  2.  Number  of  Bmsioiu  versus  tverage  error  count  for 
instructor  pilots  in  1978  study  (r  =  -.62). 


There  must  be  closer  cooperation  between  simulator  designers  and  operational  personnel.  The 
completed  and  confounding  operating  procedures  for  the  F-15A  I  S  IOSwhi.  lt  were  probably  responsible 
for  at  least  some  of  the  frequent  operator  errors,  attest  to  the  need  for  early  interaction  between  rm alator 
designers,  human  factors  scientists,  and  user  'operator)  personnel  at  the  conceptual,  design,  and  acquisiiion 
stages  of  new  trasning  device  development  c  TTiis  recommendation  has  previously  been  reported  by  other 
investigators.)  The  designers  must  solici.  and  teccive  feedback  front  users  on  the  training  effectiveness  of 
simulator  designs.  Open  communications  at  the  earliest  stages  of  design  may  help  solve  problems  such  as 
those  pointed  out  by  this  report. 

Many  of  the  changes  to  the  F  I  5  A  FS  105  recommended  by  the  MFT&K  (('rites,  1977)  and  provided 
to  the  I -I5A  FS  OT&li  manager  .'ltd  other  earlier  reports  during  the  initial  OT&F  have  recommended 
considerable  improvements  be  made  to  the  F-I5A  I  S.  liven  ihesc  changes  deserve  critical  review  to  insure 
that  ImJ  configuration  will  be  usable  in  the  operational  setting  at  unit  level.  These  changes  must  also  be 
cost  cllectivo.  Such  a  review  follows  the  theme  of  this  report;  that  is.  the  end  product  (a  production  flight 
simulator)  should  be  delivered  capable  of  providing  required  training  while  being  operated  by  personnel 
trained  to  use  the  equipment  in  an  effective  manner. 
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AtTi.NDIX  A:  SAMPLF  !!’  QUFSTIONNAIRt 

Name  _ _ Grade _ Date  _ 

SSN _ _ Sqdn _ 

FLYING  FXPLRIFNCF: 

Aircraft  Total  Hours  IP  Hours 


SIMULATOR  FXPLRIFNCF; 


Simulator 


Total  Hours 


IP  Hours 


APPENDIX  B  SAMPLE  SO  QUESTIONNAIRE 

Name _ _  Rank _ Dale 

PAFSC _ DAFSC _ SSN _ 

EXPF.RIENCF  (In  months): 

IOS  Operator _ 

Maintenance  Technician _ 

F-15  IOS__ _ 

Other  IOS: 


APPENDIX  D  DATA  FOR  CALCULATING  THE 

PLARSON  PRODUCT  MOMENT 

CORRELATION  COEFFICIENT 

Present  Study 

Prior  Study 

A verage  Error 

#o«  S*i»lon» 

Average  Error 

#  of  Sessions 

18 

1 

36 

i 

13.33 

1 

18 

i 

10 

1 

13 

i 

10 

1 

10 

i 

6.5 

1 

7.67 

3 

6 

1 

5.08 

3 

6 

1 

4.33 

3 

7.75 

1 

4.5 

4 

9 

2 

7 

5 

5.6 

2 

22.57 

7 

4 

2 

18.86 

7 

4 

2 

6.86 

7 

3.2 

2 

1.71 

7 

2 

2 

1 .71 

7 

1.5 

2 

0 

7 

1 

2 

8.75 

8 

1 

2 

7.56 

9 

0.5 

2 

6.89 

9 

« 

err 

l 

,)  ..)U 

V 

0 

3 

11.4 

10 

2.75 

4 

5.6 

10 

2 

4 

4.09 

11 

0 

4 

5 

12 

0 

5 

9.23 

13 

0.5 

6 

8.47 

17 

r  =  0.32,  (p=  .059) 


r  =  -0.62,  (p  =  . 00047) 


